Snap Angle Prediction for 360$^{\circ}$ Panorama
نویسندگان
چکیده
360◦ panoramas are a rich medium, yet notoriously difficult to visualize in the 2D image plane. We explore how intelligent rotations of a spherical image may enable content-aware projection with fewer perceptible distortions. Whereas existing approaches assume the viewpoint is fixed, intuitively some viewing angles within the sphere preserve high-level objects better than others. To discover the relationship between these optimal snap angles and the spherical panorama’s content, we develop a reinforcement learning approach for the cubemap projection model. Implemented as a deep recurrent neural network, our method selects a sequence of rotation actions and receives reward for avoiding cube boundaries that overlap with important foreground objects. Our results demonstrate the impact both qualitatively and quantitatively.
منابع مشابه
Pano2Vid: Automatic Cinematography for Watching 360$^{\circ}$ Videos
We introduce the novel task of Pano2Vid — automatic cinematography in panoramic 360◦ videos. Given a 360◦ video, the goal is to direct an imaginary camera to virtually capture natural-looking normal field-of-view (NFOV) video. By selecting “where to look” within the panorama at each time step, Pano2Vid aims to free both the videographer and the end viewer from the task of determining what to wa...
متن کاملA comparison of CRIB, CRIB II, SNAP, SNAPII and SNAP-PE scores for prediction of mortality in critically ill neonates
Abstract Background: Clinical Risk Index of Babies (CRIB), Score for Neonatal Acute Physiology (SNAP), an update of the Clinical Risk Index for Babies score (CRIB II) and Score for Neonatal Acute Physiology - Perinatal Extension (SNAP-PE) are scoring devices developed in neonatal intensive care units. This study reviewed these scoring systems in critically ill neonates to determine how well th...
متن کامل360 Panorama Cloning on Sphere
In this paper, we address a novel problem of cloning a patch of the source spherical panoramic image to the target spherical panoramic image, which we call 360◦ panorama cloning. Considering the sphere geometry constraint embedded in spherical panoramic images, we develop a coordinate-based method that directly clones in the spherical domain. Our method neither differentiates the polar regions ...
متن کاملVR HMD Compatible Spherical Stereo Panorama by Single Camera with Regular Lens
A spherical stereo panorama is a pair of panoramic images with horizontal parallax, that both have a complete spherical projection covering 360◦ in azimuth and 180◦ in elevation. We present an analyze a new method to generate spherical stereo panorama by using one camera with regular lens, which are compatible for VR HMD display.
متن کاملAutomating the Construction of Dynamic and Multi-Resolution 360° Panorama for Natural Scenes with Moving Objects
A new approach is presented to automatically build a dynamic and multi-resolution 360° panorama (DMP) from image sequences taken by a hand-held camera. A multiresolution representation is built for the more interesting areas by means of camera zooming. The dynamic objects in the scene can be detected and represented separately. The DMP construction method is fast, robust and automatic, achievin...
متن کامل